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(57) Abstract: A digital video editing 
system uses a graphical user interface 
(10) which facilitates the selection 
of a video sequence of interest and 
its representation in a conveniently 
visualized form. Through the graphical 
user interface (10), the user may select a 
starting frame (12), a time interval (14), 
and a number of frames (16) within the 
time interval which may be represented 
by thumbnail depictions (18) of selected 
video frames. Once the video sequence 
is represented by a selected sequence 
of video frames over a selected interval, 
the user can then use editing techniques 
to manipulate the portions of the video 
sequence represented by the thumbnail 
depictions. 
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Facilitating Access To Digital Video 

Background 

This invention relates generally to editing video stored in a digital format. 

A number of formats for digital video currently exist. For example, in connection 
with so called broadcast pause and resume systems, a conventional hard disk drive may be 
utilized to store streaming television programming. These systems may alternatively read 
and write video from and to the same storage medium such as a hard disk drive. In addition, 
digital video may be stored on a digital versatile disk or other optical storage media. 

Once the video has been stored in a digital format, manipulation of that video may be 
undertaken using processor-based systems. For example, conventional digital versatile disk 
players may incorporate a selective zoom function wherein the user may use a remote control 
to zoom a portion of the picture in a selected quadrant. 

However, in most conventional digital formats, the ability to edit the stored video is 
relatively limited. The user can replay the information by selecting zoom features, slow 
motion, stills, and other techniques but the ability to manipulate the data is still relatively 
limited. 

Thus, there is a need for more ways to manipulate digital video data stored on digital 
storage media. 

Brief Description of the Drawings 

Figure 1 is a screen display in accordance with one embodiment of the present 
invention; 

Figure 2 is a flow chart for use in connection with the screen display shown in Figure 

1; 

Figure 3 is a flow chart for use in connection with the screen display shown in Figure 

1; and 

Figure 4 is a block diagram of hardware for implementing one embodiment of the 
present invention. 

Detailed Description 

Referring to Figure 1, a graphical user interface 10 which may be displayed on a 
display screen of a processor-based system is useful in editing digital video data. The display 
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screen may be any of a variety of video displays. For example, the screen may be a liquid 
' crystal display on a video camera, a monitor for a computer system or a television receiver 
coupled to a set-top box. 

The graphicaluser interface 10 may be utilized to selectively manipulate digital data 
5 in the form of a plurality of video frames 1 8. The plurality of frames 1 8 may be 

automatically displayed as a storyboard or gridwork of thumbnail displays. Thus, each frame 
is shown in a reduced size commonly called a "thumbnail". A video sequence to be edited 
may be represented by the thumbnail frames. The sequence, may be selected from a longer 
video by choosing a start time and a time interval from the start frame. The number of 

1 0 thumbnail frames over the selected interval, taken at regular times, may also be selected. 

The user may use an icon 12 to indicate the start time for the selection of the 
thumbnails 18. The time interval icon 14 may be utilized to indicate the amount of time 
within a longer video sequence which is of interest. The icon 16 allows the number of frames 
within the selected time interval, starting at the start time, to be selected by the user. For 

15 example, with the start time icon 12,. an increase button interface 22 and a decrease button 20 
are provided on either side of a display 24 vary the selected start time. The display 24 may 
indicate the selected start frame by a time indicator. 

The frames of any video sequence may be enumerated using a conventional time 
based system such as the standard promulgated by the Society of Motion Picture and 

20 Television Engineers (White Plains, New York 1 0607) denominated as SMPTE 1 2M- 1 999 
Television, Audio and Film-Time and Control Code. Each frame may be identified by a time 
in hours, minutes, seconds and thirtieths of seconds, with video having 30 frames per second. 
A start time may be indicated in second fractions, seconds, minutes and hours. 

When the user presses the increase button interface 22, the start time, displayed on the 

25 display 24, increases. Similarly, the time interval, during which the thumbnails 1 8 are 

selected, may be controlled by an icon 28 which causes the time interval to be increased, and 
an icon 26 which decreases the time interval. In the' illustrated embodiment, the start time is 
the time zero and the time interval is sixteen minutes. Thus, sixteen minutes of video are 
selected for producing the thumbnails. The number of frames selected within the time 

30 interval, entered through the icon 1 6, may be increased with the button interface 36 and 

decreased with the button interface 32. The number of frames are indicated in the display 34 
as being sixteen in the illustrated embodiment. 
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Thus, as indicated below the icons 12, 14 and 16, sixteen thumbnail frames at one 
minute time intervals are displayed. A frame is selected at the beginning of each one minute 
increment. For each minute of video, using video at thirty frames per second, one thousand 
eight hundred frames are represented by the single starting frame illustrated as a thumbnail 
5 18. Thus, each minute after the initial starting time of zero, a frame is selected and displayed 
as a thumbnail 1 8 until sixteen frame thumbnails 18 are displayed. Since the number of . 
selected frames was sixteen, sixteen minutes were selected as the interval and the start time 
was zero, starting from the beginning of the video, sixteen thumbnail frames 1 8 are 
displayed, one for . each one minute of video. 

10 The user may increase the start time from that illustrated in Figure 1 and may increase 

or decrease the selected time interval and the number of frames as described previously. 
Thus, the user can select a given resolution in the terms of the number of frames to control 
the manipulation of the video sequence. The length of the video sequence in terms of the 
time interval may also be selected. Likewise, the location of the video sequence of interest 

15 may be controlled. 

Once a representation of a given time interval of a video sequence is created, via the 
graphical user interface 10, the user can set about editing that video sequence. For example, 
sections of the time interval of video frames, displayed on the graphical user interface 10 may 
be eliminated by simply indicating a start and stop frame 18 for the group of frames to be 

20 eliminated. The start and stop frames and the intervening frames (between the start and stop 
frames) are thereby eliminated. 

Similarly, different video effects may be applied selectively to a video sequence 
represented by the thumbnail frames 1 8. For example, fade ins, fade outs or other video 
effects may be provided. The light intensity of the various frames may be changed as well. 

25 The graphical user interface 1 0 provides a convenient way to manipulate a given section of 
video data. Through the use of the icons 12, 14 and 16, the window which defines the way 
the video sequence is visualized for editing purposes may be easily adjusted by the user. 

The software 38 for implementing the graphical user interface 1 0, shown in Figure 2, 
begins by determining whether the graphical user interface 10 has been selected as indicated 

30 in diamond 40. If so, the flow waits for a start time selection through the icon 12. Once the 
start time is selected, the first frame is designated, grabbed and stored as indicated in block 
44. Next, the flow waits for the time interval selection as indicated in diamond 46. Once that 
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selection is made, the portion of the video which is of interest is defined and the 
corresponding frames may be grabbed as indicated in block 48. Finally, the number of 
frames that are utilized to represent the video may be provided in response to a query 
represented by the diamond 50. Once that information is provided, the software 38 may then 
display the graphical user interface 1 0. If any of the selections are not timely made through 
the icons 12, 14 and 16, default values may be entered automatically. 

Referring next to Figure 3, the software 60 for editing the video represented by the 
graphical user interface 10 may implement a frame elimination protocol in one embodiment 
of the present invention. Initially, the user indicates a start frame as indicated in diamond 62. 
Once the user indicates a start frame, that start frame identifier is stored as indicated in block 
64. The identifier may include an hour, minute, second, and subsecond designation of the 
particular frame in the sequence. That information may be provided in a header associated 
with the frame. Next, the software 60 awaits the user's input of an end frame as indicated in 
diamond 66. Once this input is received, the end frame identifier may be stored as indicated 
in block 68. The intervening frames are then eliminated as indicated in block 70. 

In this way, the graphical user interface 10 provides an easy way for the user to 
visualize a sequence of video. The software 38 creates a graphical user interface 1 0, 
including the icons 12, 14 and 16, that facilitates the manipulation of the storyboard which 
represents a video sequence. 

Embodiments of the present invention may be used as a suppression tool, suppressing 
access to offensive or obscene video portions. For example, a parent may wish to prevent a 
child from viewing portions of a video. With the present invention, a series of frames of 
video may be tagged to prevent viewing under certain circumstances. For example, an access 
code may be required to view the tagged sequence of frames. 

Another application for embodiments of the present invention is in connection with 
so-called broadcast pause and resume systems. These systems enable a user to store and 
replay video at the same time. However, the user must also navigate through the video 
sequences to facilitate the broadcast pause and resume features. Using embodiments of the 
present invention, one can readily navigate within the stored video. 

A processor-based system 72, shown in Figure 4, in accordance with one embodiment 
of the present invention generates the graphical user interface 1 0 on a television display 84. 
The system 84 is a set-top box but the present invention is in no way limited to this 
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embodiment. It is applicable to a wide variety of systems which display and store digital 
video information including digital video cameras, desktop computers, laptop computers, 
portable and handheld devices, appliances, as examples. 

The system 72 includes a processor 74 coupled to an accelerated graphics port (AGP) 
5 chipset 76 for implementing an accelerated graphics port embodiment. The chipset 76 

communicates with the AGP port 80 and the graphics accelerator 82. A television 84 may be 
coupled to the video output of the graphics accelerator 82. The graphical user interface 1 0 
may be displayed on the television 84. The television 84 may be coupled to the video output 
of the graphics accelerator 82. The chipset 76 accommodates the system memory 78. 

1 0 The chipset 76 is also coupled to a bus 86 which may be, for example, a Peripheral 

Component Interconnect (PCI) bus. The PCI Local Bus Specification, Rev. 2.2 is available 
from the PCI Special Interest Group, Portland, Oregon 97124. The bus 86 connects to a TV 
tuner/capture card 88 which is coupled to an antenna 90 or other video input such as a cable 
input, a satellite receiver/antenna or the like. The TV tuner/capture card 88 selects a desired 

15 television channel and also performs a video capture function. One exemplary video capture 
card is the ISVR-III video capture card available from Intel Corporation. 

The bus 86 is also coupled to a bridge 92 which couples a hard disk drive 94. The 
software 38 and 60 may be stored on the hard disk 94 together with the video sequence being 
manipulated. The bridge 92 is also coupled to another bus 96. The bus 96 may be coupled to 

20 a serial input/output device 98. The device 98 is in turn connected to an infrared interface 
100 which interacts with a remote control unit 104 which is also infrared based. Also 
connected to the bus 96 is a basic input/output system (BIOS) 102. 

While the present invention has been described with respect to a limited number of 
embodiments, those skilled in the art will appreciate numerous modifications and variations 

25 therefrom. It is intended that the appended claims cover all such modifications and variations 
as fall within the true spirit and scope of this present invention. 
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What is claimed is: 

1 . A method comprising: 

receiving an indication of a start time for a video sequence to be edited; 
receiving an indication of a time interval within the sequence to be edited; and 
receiving an indication of a number of frames that are to be utilized to 
represent the video sequence. 

2. The method of claim 1 including providing a graphical user interface with 
icons for the entry of information concerning the start time, time interval and number of 
frames. 

3 . The method of claim 1 including providing a graphical user interface which 
provides fields for entering data and displays a series of video frames in thumbnail format. 

4. The method of claim 3 including providing a default value if data is not 
received within a predetermined time period. 

5. The method of claim 1 including providing a graphical user interface which 
indicates data for a start time, a time interval and a number of frames, and providing buttons 
to increase or decrease the data. 

6. The method of claim 1 including receiving edit commands using thumbnail 
depictions of representative frames. 

7. The method of claim 1 including representing a video sequence as a number of 
thumbnail depictions of exemplary frames within said sequence, said frames beginning at the 
entered start time, 

8. The method of claim 6 including enabling the number of depictions to be 
selected by the user. 
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9. An article comprising a medium for storing instructions that cause a 
processor-based system to: 

receive an indication of a start time for a video sequence to be edited; 
receive an indication of a time interval within the sequence to be edited; and 
receive an indication of a number of frames that are to be utilized to represent 
the video sequence. 

1 0. The article of claim 9 further storing instructions that cause a processor-based 
system to provide a graphical user interface with icons for the entry of information 
concerning the start time, time interval, and number of frames. 

1 1 . The article of claim 10 further storing instructions that cause a processor- 
based system to provide a default value if data is not received within a predetermined time. 

12. The article of claim 1 0 further storing instructions that cause a processor- 
based system to provide a graphical user interface which provides fields for entering data and 
displays a series of video frames in thumbnail format. 

13 . The article of claim 1 0 further storing instructions that cause a processor- 
based system to provide a graphical user interface which indicates data for a start time, a time 
interval, and a number of frames, and provides buttons to increase or decrease the data. 

14. The article of claim 10 further storing instructions that cause a processor- 
based system to receive edit commands using thumbnail depictions of representative frames. 

1 5 . The article of claim 1 0 further storing instructions that cause a processor- 
based system to represent a video sequence as a number thumbnail depictions of exemplary 
frames within said sequence, said frames beginning at the entered start time. 

16. The article of claim 15 further storing instructions that cause a processor- 
based system to enable the number of depictions to be selected bv the user. 
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17. A system comprising: 
a processor; 

a storage coupled to said processor, said storage storing software that creates a 
graphical user interface that receives an indication of a start time of a video sequence to be 
edited, an indication of a time interval within the sequence to be edited, and a number of 
frames that are to be utilized to represent the video sequence. 

1 8. The system of claim 17 wherein said system includes a display coupled to said 
processor. 

19. The system of claim 17 wherein said graphical user interface displays a video 
sequence as a series of thumbnail frame depictions. 

20. The system of claim 19 wherein the user can manipulate said frames as 
thumbnail frame depictions. 
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